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Presarvice elamentary teachers' uae of examplaa in 
recognizing and disproving invalid deductive arguments related to 
topics in elamantary school mathematics was examined* Iiro forms of 
tha Classroom Logic Test were developed^ one multiple choice and pne 
free responsa* Subjacts were asked to judge the correctness of 
arguments and^ if incorrect^ provide feedback. lasts were 
administered to 50 students enrolled in a mathematics methods course* 
The major finding indicated that subjects provided thiS list of 
options erred by rejecting valid arguments^ while those not given the 
list acceptad invalid arguments* Findings ara related to issues in 
mathematics teacher education. (Author) 
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Several recent stTxaiafl (liaenterg Kid McGlnty 1975 1 J^s- 
son 1975, JTarasehek 1976, DMmrin 1977 > hme addreased the Issue 
of lo^cfQ. aMlltloii among pre8ei*9iee elementaj?y teaeherB, Most 
of tkese studies hav® "boen, coaceraed iflth the ability to make 
approprlBte Inference b» In gentrfia they have Bhom that the pre- 
Berviee teachers tested perfoOT rather poorly? that ifl, they draw 
Inappropriate eoncluslonB from pairs of statementB 0.ven to them 
In paper Mid penoil testo. 

Wille these stTJ^les are Interestingj, and even a 'bit dlstw- 
blng, It la difflctilt to interpret their Implications for teacher 
edueatlon, Ihe sttidleB have "been made and reported hy matheBw,- 
tlcs educators* Yet the Item content uaed has not "been mathema- 
tical. Sevei'al questions arise oonceming the relationship of 
these studies to the educatioii of teaoherB; 

- Why do we care that teacherB can make logical inferences? 

- How is perfOMiance on traditional tests of logical infer- 
ence, tests in which infer enoes are maae ahout brown dogs 
and shiny oars, related to the ability to make logical 
inferences in mathematical contexts? 

- What are the mental processes involved in the drawing of 
correct inferences from statements involving logical con- 
nectives? 

Ajialysls of these questions points to new lines of research in 
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the araaB logioia aMlitles and lo^cal training fo^ pre- 
seryice elemantary tesehers. 

Ths ability , of teaohera to use and interpret the iBn^ 
go&gQ of olaes Kid eondltional lo^Cf and to draw appropriate 
inferences from statements in thes© fonnSi^ wo'uld seem to be of 
a priori importMice. Moreover ^ there is eome empirioal support 
for the impoi*tance of this const ellation of abilities. Gregory 
and Osborne (1975) haTO showi that Jteiior High Sohool students 
of teachers who regulMfly use the langimge of conditional lo^o 
score better on tests of critical thinking than students of 
teaehers who do not use this lan^iage. 

In his oomprehansiTe review of the iiteratiare on diseoirery 
learning^ Strike (1976) argues that the *'logla of verification*^ 
lies at the core of this inetructioniCL approach. DisooTery 
learning would seem to be an appropriate instruotloniLL strata^ 
only in Bituatione in which that wMch is to be leawied is a 
principle, rulti etrate^s or another sort of gener or 
generali sable phenomenon* 

Structure or generaligable principles have not been the 
content of items in traditional tests of the ability to mak© 
logical inferences I item content hm been related to hypothetical 
relationships among fMailiar objects (e.g., "If the cw is shiny, 
then it is fast,'* and ^'The dog is brown or the bi^l is blue***). 
In vernacular speech about such f amiLllar objects the words which- 
serve as loffLci^ connectives are interpreted differently from 
the Interpretations applied to them in more straotured conte3rt;s 
demanding rigorous logiori thought. It is possible, therefore, 
that performance on these tests would. be imrelated to the / 
ability to reason logically in struotured eonte%ts such as 
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mathenaLtlcs • 

Charact©i*istle of Buoh sitmtions is the need to use pro- 
perties to olassify objects or ooncepts, and to use the logical 
relationsliips among properties or clssaes to determiiie or inter- 
pret the truth of statements or Taaidity of arguments* ire^ous 
research (Damarin 1976, to appaar] indicates that the ahility of 
preserviee elementsry teachers to use stateraenta which convey 
emthematioal inf oMatton throu^ logical DOimeotiTes is close- 
ly related to the ability to sort the set of poflsiblo eoffibinatlons 
of propartieB, This researoh has been «abstraot," that Is, it 
has inTolved symholic taskB related to the oonocpt of odd aiad 
even integers. Performanee on these tasks differed from per- 
forMJiee by siMlar subjects on traditional inference tests. 
The question of how performance on this type of task is related 
to the judgement of argiMent validity in a claosi-oom Betting is 
one of interest and importance. 
The Study 

The study ms deBl^ed with two tuestions in mind i (l) how 
accurately do preservioe teaohers judge (children's) argiments 
about mathematics, and (2) to what extent do they use counter- 
examples when criticiKing invalid argents? Two conditions were 
compared; in the first subjects were given arguments and a list 
of combinations or properties of the phenomena to which the argu- 
" - ments applied I in the second condition Bubjects were given only 
the arguments, 

Trooedures . Two foraifl of the Classroom Logt.c Test (OLT) were 
developed, laoh item contained am argument concerning a point 
in elementary school mathematics. Elementary education majors 
enrolled in a course on methods of teaohing mathematlos 
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were asked to imagine themselves as teaoherg aiid the arguments 
as ^-^en by their students. Under these assiamptions they were 
to jiilge the argiments as correct or Incorrect, and^ if in- 
correct ^ provide feedback for the student making the argi^ent. ' 
Items in OM-A Included lists of four ©xmples (or example types) 
from which feedback was to be selected* OIiT-B items required 
subjects to Invent and wite out their owi feadbacfct^ The same 
arguments were presented in both forms f 5 were correct Mid 13 
InoorTeot. Directions and sample items from CLT-A are presan*- 
ted In table 1| CLT-B directions Mid Items differed from tbeee 
onlji' in the instructions for prOTidlng feedback. 

Insert Table 1 about here 

Test forms were randomly assigned to 50 students and com- 
pleted during a re^alar session of a com'se on methods of teach- 
ing mathematics. Items were scored for Judgements of arguments 
and for type of feedback provided. Responses to the two forms 
ware compared on the basis of response frequencies and order of 
it#m diffloixLty, 

Re suit B p Error fraquenoles for the jludgement Qf arguments are 
presented In table 2| these frequencies were submitted to a Chl- 
square analysis p and a sl^lfioajnt difference in error patterns 
was detected (% - 10.75f p< #01). Subjects gL^en form A made 
a vp*©ater proportion of errors by rejecting Talld argument s.| 

Insert table 2 about here 
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while those given form B erred by accepting inTalid arguments, 
men the aistribution of correct and inooi^ect arguments was 
taken Into account there was no diffarenos in the OTerall diffi- 
culty of the two tests. 

Items from each test were rank**ordered according to dif** 
ficulty of arpment j-udgeaentsi the apeamaa rs^-order cor- 
relation between the two foams was found to be ei^lfloewt ( t - 
2,75, p m02p two«tailed test). Thus the presence or absence 
of examples did not hare a serious differential effect on the 
judgement of Indi^dual arguments* 

Follovrt.ng the analysis of argument judgements the res- 
ponses to "feedback** parts of items using invalid arguments were 
coded to reflect use of examples, counter-examples # or (in CLT-B) 
other feedback^ as well as omissions or wong judgements. The 
coding systtm^ and frequencies for coded responses, are presen- 
ted in tabid 3. When distributions were compared it was fomid 

Insert table 3 about here 

that on both foras the majority of subjects who judged Invalid 
arguments to be Incorrect provided counter-#xamples as feedback 
(78.6^ for CLT-A, 56»6f5 for OM-B) • Items were rank-ordered 
according to the tendency of subjects to provide counter-exam- 
ples , and the SpearraMi rank-order correlation was computed* 
This coefficeint was not si^ificaurit (t #9475) suggesting 
that item content interacted with the availability of options 
to determine whether coimterexaraples would be used* Examina- 
tion of individual item responses bore out this observation i 
several Items in form A seemed to lure subjects to responses 
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whioh were not produoad at all by subjeots using form B, 
DlaougalQn 

Data analyslB indloatad that the presence, .of a list of 
possible axajnples had two effects i it enhanead the abilities of 
subjaots to identify invalid arguments, but it also debilitated 
their abilities to raco^i^e Talid .a^giments# Subjaots who were 
gLven the list of options were somewhat more likely to select 
ooimter-examples as feedback for incorrect arpaments thaja sub- 
jects who ware not gLv-mn this list. Although the mathamatioal 
content of items did not seem to interact with the availability 
of options in determining the difficulty of ji^0.ng argtoment 
Talidityi maoh an interaction was observed in the assl^ment 
of faadback. 

These oonsldaratlonsi coupled with findings (DamE^ln 1976) 
that the ability to use the set of releirait possibilities facili- 
tates appropriate interpretation of propositlonal statamentst 
suggest that matheiQatioal preparation of tlementa^ teachers 
shoiald focus more directly on the domains OTer which mathematical 
statements and strgujjttents haT© maanlngt and on the sat of poesl- 
bllltles which must be considered before asserting th# truth of 
a statement. 

The research reported indicates that future taaohers who 
had aTOllable the set of possibilities to be oonfltderedtandad 
to era* b^ rejecting -r^id M^gtments, ^hlle those not ha'^ng 
this set aTallable ei^ed by accepting InTOlld arguments, yrom 
an instructional point of -^ew the latter error would seem to 
be more serious. If a teacher dlsa^eas with the cori^^ot aon- 
jecture of a student, the student can ar^e his oaset ^en a 



teacher supports an Incorrect conjectare or argument, on the 
other hand, errors of thinking ace reinforoed. 
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Table 1 



Direct ions a^d Sample Items (CTT-A) 



CIASSROOM LOGIC TEST 

Direefciens ^ Imagine that your claes has just taken a speaial test 
for a state-^wide math aontest^ and that you are now leading a 
Qlamm diseussion of the problems on the test* As each student 
presents his interpretations and ideas eonoerning various problems 
you want to provide appropriate feedbaok to him or her. 

For each item 

Rgjg the student's statement carefully and deoide whetoer the 

arfiunent is oorreot or ineorreet* 
Plaoe a ehQoH ( which indicates yaur jud^ent c©noerning the 

student's argument* 
If you uheek correat# go on to the next question* 
If y©^ check incorreat, read the four options i and place a check 

C Vj beside the one you would show the student in order to point 

out his error to him* 

Work the Sample items belowi 

A, Jackie I If a number is even^ then the romainder is Q when 

you divide by 2* In this problem the nwnber is evenf and 
we're diyidinf by 2, so the remainder is 0, 

Jaokie is eorreet 



Jackie is incorrect; I would show her 



An even number with remainder 0 when divided by 2* 

An even nu^er with remainder 1 when divided by 2* 
An odd niaciber with remainder 0 when divided by 2* 

An odd niimber with remainder 1 when divided by 2, 

1. Tlmi In this problem the number A is either 0# 1/ or 2, and 
B is bigger than C, Therefore AB is bifger than AC* 

Tim is correct* 



Tim is incorrect* I would show him A, B, wd C with 



1 greater than C* AS greater than AC 

. 1 greater than C, AB equal to AC 

1 less than or equal to C# AB greater than AC, 

1 less than or equal to AB equal to AC 

Mow turn to the next page and check your answers to the simple items 
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Table 2 

Errors on correct and inoorrect arg\iinents^ 



Argument is CLT^A CLT-B 



correct 28 errors 14 errors 

incorrect 101 errors 154 errors 
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Table 3 

Coding wid frequencies for f eed*baok to arguments 



Response type 


CLT-A 




Numbar of "inaorreot" 
judgements 


222 


171 ; 


Feadbaak 




■ - - , 


Couriterexaftiple (*) 


179 


Ill 


h, B, C, or D (not 
GOuntereKOTipla) 


38 


7 


E ' 




18 


F 




15 


0 




12 


X ; 


5 


-8 .■. , . 


N 


96 


135 


Item omitted entirely 


7 


19 ■ 



non--contereKemplas presented in CLT^A 

D 

* counteraxampla 

E example provided or discussed; not clearly one of 
the above ^ but mathematically sound 

_ . f ■ . .. ; 

F faulty axMiple (e»g* arithmetic error) 
O other response 

X no response (although argiment labelled incorrect) 
N argiiment labelled correct 
Item omitted completely 
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